Advertisements over a network

ABSTRACT

Integrated imaging and GPS network monitors remote object movement. Browser interface displays objects and detectors. Database stores object position movement. Cameras detect objects and generate image signal. Internet provides selectable connection between system controller and various cameras according to object positions.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patentapplication Ser. No. 11/394,554 filed on Mar. 31, 2006, now U.S. Pat.No. 7,830,962, which is a continuation application of U.S. applicationSer. No. 09/823,508 filed on Mar. 29, 2001, now U.S. Pat. No. 7,920,626,which is a divisional of U.S. patent application Ser. No. 09/045,412,filed on Mar. 19, 1998, now U.S. Pat. No. 6,697,103.

FIELD OF THE INVENTION

The invention relates to remote surveillance and communicationstechnology, particularly to integrated fixed and mobile networkelectronics and related software for object attribute processing.

BACKGROUND OF THE INVENTION

Remote or local object monitoring schemes have been used for variousspecific surveillance applications, such as closed-circuit securityvideo systems, as well as wireless mobile navigation systems usingrelatively near reference or distant satellite signals (e.g., GlobalPositioning Satellite system (GPS)). Prior techniques and systems forremotely monitoring typically provide positional or visual informationof interest about certain object context, e.g., bank facilitysurveillance (see: U.S. Pat. Nos. 4,524,384, 4,511,886), or truckingvehicle movement (see: U.S. Pat. Nos. 5,673,305, 5,223,844); however,such prior art schemes are necessarily limited to addressing eitherfixed or mobile context specifically for which the particular monitoringsystem has been designed originally.

Hence, there is need for more flexible and scaleable solution formonitoring and processing remote objects according to various moregeneral context and related object conditions.

SUMMARY OF THE INVENTION

The invention resides in an integrated fixed and/or wireless network andassociated database and software functionality for monitoring andprocessing remote and/or local moveable objects. Preferably, the systemimplementation integrates single-chip digital imaging camera and GlobalPositioning Satellite system (GPS) receivers through generallyaccessible server processors using the Internet network and a softwarebrowser or functionally equivalent interface coupled thereto formonitoring and analyzing remote or local movement of one or moreobjects.

An object database or functionally equivalent data structure provided indigital storage and accessible to control software dynamically storesone or more positional and relative movement as well as optionalassociated map data. Various digital cameras preferably disposed atcertain fixed and/or movable locations detect mobile objects andgenerate object image signal for processing thereof as described hereinfor applications.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a general block diagram of an integrated fixed and mobilesystem for monitoring and analyzing remote or local object(s) accordingto the present invention.

FIG. 2 is a more detailed block diagram of target unit 4 of FIG. 1provided according to the present invention.

FIG. 3 is a more detailed block diagram of controller 6 of FIG. 1provided according to the present invention.

FIG. 4 is a block diagram of the general methodology of the integratedsystem for monitoring remote objects according to the present invention.

DETAILED DESCRIPTION

FIG. 1 illustrates a general block diagram of preferred embodiment ofintegrated fixed and/or mobile network system or apparatus forperforming real-time, historical and/or predictive monitoring and dataprocessing of one or more remote or local objects 2. As used herein, theterm “object” is construed broadly to include any singular or multiple,wired or wireless, chattel, person, animal, or property. Furthermore,term “signal” is also construed broadly to include any electronicdigital and/or analog pulse or other recognizable or coded waveform, aswell as any digital bit stream or other processor-recognizable value,variable or data form.

For example, object may represent one or more member belonging to commonor assigned family, classification, or other actual or virtual groupingor enterprise. It is further contemplated that objects 2 could includeany moveable (e.g., pedestrian, vehicular, etc.) physical item, such asperson, animal, vehicle, mobile fleet, containers, belongings, or othernon-fixed chattel which may change location relative to one or morefixed locations, such as general transit paths or other typicallynon-moving sites (e.g., hallways, roads, railway, etc.), homes, offices,schools, hotel, hospitals, warehouses, stores, etc.).

Preferred integrated network monitoring system includes one or morecentral console controller or user processor 6 coupled to digital switchor other selectively accessible, packet and/or circuit-switched networkcommunications infrastructure 8. Network 8 may be functional aggregateof multiple sub-networks including conventional or proprietarynetworking equipment for enabling access to and/or through the WorldWide Web (WWW), or other functionally equivalent local and/or wide areanetwork (LAN/WAN) interconnectivity.

Network 8 provides digital connection to or from any allocated web nodeaddress or equivalently accessible network resource, such as UniformResource Locator (URL), associated hypertext files, and other properdomain name and file location, according to Transmission ControlProtocol/Internet Protocol (TCP/IP) addressing scheme and properhypertext file transfer protocol (HTTP). In this way, networking isachieved via one or more network ports or other functionally equivalentservers and/or other conventional wired or wireless network accessequipment (e.g., router, modem, hub, bridge, etc.) configuredconventionally for transferring and/or transmitting data to/from and/orthrough the Internet. Such World Wide Web and Internet protocol andassociated networking and remote access standards as are specified inpublished hard-copy or on-line documents are hereby incorporated byreference.

As used herein, term “proprietary” pertains to knownprivately-implemented digital networking techniques, equipment, orrelated electronics and software, however, configured at least in partaccording to non-standard manner and may still be standard compliant.

Controller 6 preferably is implemented for user monitoring of one ormore objects 2 using conventional computer, workstation or functionallyequivalent digital processing equipment and/or software. Contemplatedexamples of controller 6 functionality may include following, ifconfigured to operate as specified herein: Network Computer-type productfrom Oracle, WebTV-type product from Microsoft, Pilot-type product fromCisco or substantially compatible network processor products thereto.Publicly accessible product functionality and interface specifications,including hard-copy or on-line published documents therefor, for suchproducts are hereby incorporated by reference.

Controller 6 may include one or more standard digital microprocessorunit, operating system software (e.g., Windows, NT, CE, etc.), digitalstorage devices (e.g., disk, memory, cache, etc.), output/input devices(e.g., keyboard, monitor, mouse, microphone, speaker, camera, etc.).Furthermore, controller 6 may include conventional network accessinginterface firmware or circuit, such as Ethernet card, and remoteprocessing or network access software such as web browser (e.g.,Netscape Navigator, Microsoft Explorer, etc.), preferably usingconventional or proprietary text, graphics, and other media format, suchas Hyper Text Markup Language (HTML), Extensible Markup Language (XML),JAVA, or streamed video or audio data format. In this configuration,real-time or stored remote and/or local access is achieved via theInternet or functionally equivalent enterprise or intranet network ofobject data to or from one or more target units 4, for example, inaccordance with the present invention.

As shown, network 8 further couples to one or more conventionalInternet, intranet or other LAN/WAN network connection or server 5 andsensor or detector 3, as well as communicator 7 for communicating,preferably through conventional or proprietary wireless connection, toone or more target unit 4. Note that server 5 may be any electronichardware, firmware or software sufficient to couple detector 3electrically and accessibly to network 8, and that detector 3 mayprovide substantially equivalent input functionality of sensor 44 oftarget unit 4. Preferably, electronic interface coupling between server5 and network 8 provides for dynamic “hot-swap” interoperability, suchthat minimal network re-configuration and associated delay is required.

For example, server 5 may be provided as simplified electronic networkdevice having conventional processor, embedded controller, or digitalsignal processor with real-time kernel or operating system, storage,Ethernet and/or modem facility, as well as electrical connectivity todetector 3 or other appliance, such as through Universal Serial Bus(USB), X-10, IEEE1394 (FireWire), or other conventional electricalsignaling standard interface, which published specifications are herebyincorporated by reference. Hence, server 5 preferably includes uniquelyidentifiable IP address or subset packet addressing scheme associatedtherewith; and preferably more than one detector may be uniquelyaccessible, in parallel or multiplexed, by single server.

In this combined or integrated fixed and mobile network arrangement,controller 6, which in combination with network 8, communicator 7, aswell as servers 5 and corresponding detectors 3 coupled thereto arelocated in relative fixed locations, and communicates with oreffectively monitors through network 8. Preferably such arrangement usesconventional TCP/IP protocol Internet website addressing scheme, one ormore fixed or movable object 2. This is performed by accessing real-timeobject data or other contextual information available or accessible viapublic or private IP address or other website associated with orsupported by one or more detector 3-server 5 coupled pair.Detector-server coupling sites are disposed within detecting, viewing,or other physically proximate range relative to one or more specifiedobject or set of objects 2.

In accordance with an important aspect of present invention, integratednetwork connectivity is planned such that one or more detectors orsensors 3 are installed at preferably fixed, although possibly slightlymovable, physical sites or locations in deliberate and distributedfashion. As used herein, term “fixed” is understood to mean un-movablymounted, at certain physical location or limited area, although stillrelocatable to other fixed sites, and still adjustable or redirectablewhile at such fixed site, for example, to point at different directionor angular displacement. In comparison, term “mobile” is understood tomean movable or moving relative to such fixed sites.

Following are sample location categories or site classes: common publicor private areas including carrier transit (transport stations, bus,train, plane, ship, taxi, emergency/transport vehicles, etc.), assetstorage (warehouse, library, etc.), transport paths (roads, hallways,rivers, sidewalks, etc.), general human transaction sites (stores,schools, homes, hotel, hospitals, sports locations, mobile homes, parks,etc.).

Integrated network growth is planned according to actual or anticipatednetwork communication traffic corresponding to particular coupleddetector-server sites, sets or geographical clusters thereof, such thatlocations associated with higher density of objects and/or movementthereof are installed with additional monitoring detector/serverfacilities. Accordingly, integrated system database maintains andupdates past, current and planned location for each sensor coupled tosuch system, preferably as function of time or schedule. Additionally,when existing detector and/or server site is relocated, correspondingdatabase entries 162 are updated.

Detectors 3 may be single or multi-chip charged coupled device (CCD)and/or complementary metal oxide semiconductor (CMOS) digital imager orvideo capture devices, or other functionally equivalent monitoringapparatus for optically (e.g., black & white, color, infra-red, etc.)sensing and transmitting static and/or moving image signals. Preferably,detector 3 includes display indicator, such as light-emitting diode(LED), which indicates obviously to any nearby monitored person whensuch detector 3 is actively in monitoring mode, or other conventionaldisplay for indicating identity of monitoring party name, console sourceor location.

Furthermore, such detectors 3 may be implemented in non-imaging physicalsensor manner, such as magnetic or smart card or reader, tactilefinger-print sensor-type device, medical analog and/or digitalinstrumentation for measuring patient vitals and related records (e.g.,pacemaker operation, temperature, blood pressure, mental activity,electrocardiogram, medication level, and other similarly monitorableinformation and signals).

Alternately in facility monitoring application, detectors 3 may beimplemented to sense state and other measurement signals from motiondetector, burglar alarm, door or window open/close detector, smokedetector, thermostat, phone answering machine, or other electrical homeappliance. In certain instances, e.g., unauthorized home entry, suchsensed state may trigger other functionality, such as taking electronicphotograph and/or notifying certain entities. In this home application,such appliance may couple electrically to network 8 via server 5 orother functionally equivalent interface, for example, using standardelectrical signaling interface such as USB, IEEE1394 (FireWire), orso-called X-10 interface for communicating through standard electricallines coupled thereto.

Optionally, detectors 3 may be coupled to control mechanism foradjusting detector operation, such as focus, tilt, pan, focus, etc., aswell as means for causing multiple neighboring detectors to observe andtrack common object or object set, thereby obtaining various comparativesurveillance data. Further optionally, un-coupled or non-functional butobvious “decoy” detector/server sites may be installed at selectlocations to provide deterrent observation effect as well reduce networktraffic and overall cost. However, hidden detector/server site may beprovided to observe object activity proximate to decoy site.

In accordance with an important aspect of present invention, detectors 3are accessible through the Internet, intranet, or other functionallyequivalent networking connection. In this way, currently detected objectdata signal may be obtained therefrom. Any one or more user with properaccess capability (e.g., computer with browser, Internet access, andproper authorizations) may observe or download such object datainformation, either in multi-cast mode (i.e., multiple observingcontroller users belonging to group, neighborhood or other commoninterest monitoring same detector or object or set thereof,) orpoint-to-point mode (i.e., single observing controller user monitoringone or more detector or object or set thereof). Data download may bedelivered in JAVA applet format, preferably including search-ableembedded pixel image or digital watermark, or otherwise authorized onlyto run on specified sites or processors. Preferably, each detector 3couples continuously to provide digital data stream to Internet 8generally through corresponding server 5 having identifiable IF address,packet identifier, or other network link to file or directory containingdesired monitored object data.

Moreover, accessed object data or other contextual information may beobtained by one or more monitoring user controller 6 through network 8and one or more conventional or proprietary wired or wirelesscommunicator 7 coupled thereto for communicating with one or more targetunits 4 as well, preferably via public or private IP address or otherwebsite associated with or supported by one or more target unit 4located physically with or proximately observable or detectable to oneor more monitored object 2. In such distributed client-serverconfiguration including communicator 7 and one or more target unit 4, itis optionally contemplated that functionality and operation ofcontroller 6 and one or more target unit 4 may be functionallyequivalent or redundant.

In accordance with an important aspect of present invention, one or moremobile target units 4 are provided to move with and observe anassociated object 2. Target units 4 preferably are wirelesscommunications devices which function also determine current objectlocation and movement, as well as sensed or detected condition, image,sound, etc. Accordingly, target units 4 may couple wirelessly to atleast one controller 6 through network 8, as wireless communicationservice 7 provides conventional or proprietary connectivity between theInternet and target units 4.

Hence, in this combined innovative architecture and methodology, theoverall integrated system preferably includes a geographically orrelatively fixed network of multiple detectors each uniquely accessiblethrough Internet browsing interface, overlaid with a mobile set oftarget units 4 closely associated or attached to certain objects 2 forremote monitoring thereof. More accurate object monitoring is achievedby using multiple fixed detectors, especially in conjunction with mobileobject detection, motion surveillance, processing, analysis, diagnosisand/or update reporting software provided therewith. Additionally,substantially improved and low-cost surveillance scaleability andaccessibility is achieved by leveraging the Internet and/or variouscomparable networking infrastructure to provide wired and/or wirelessconnectivity.

Further, as described herein, control software 66, preferably includingone or more modules described hereunder and provided in whole or in partin storage 49 for execution by processor 48 in target unit 4 and/orcontroller 6, to enable communications 161 between such fixed and mobilecomponents, maintain object data status and mapping information 162,track and correlate movement activity from different sources 163,maintain system security and access 164, manage object-relatedelectronic transactions 165, diagnosis and analyze object performance,provide data reporting, and analyze visual object information 168.

Target units 4, shown in FIG. 4 block diagram, are disposed for relativeobject 2 communications, tracking and monitoring at various fixed ormovable locations in selected topology or geography preferably inanticipated or known paths of object 2 movement relative to fixedlocation of controller 6, network 8, communicator, server 5, or detector3. Target unit 4 may include sensor unit 44, communicator unit 46, andlocator unit 42, as well as portable power source (not shown) preferablyincluding low-power indicator. Preferably, target unit 4 usesnon-volatile memory such that digital stored data is not erased duringpower outage.

Sensor unit 44 may include one or more video cameras, active sensor,infra-red detector, microphone, or other optical, medical, or otherwisephysical monitoring or observation device to provide real-time objectdata, such as audio and/or video signals, or other electronicallydetectable frequency signal, such as infra-red, or other analog ordigital electrical signal sensed from monitored object 2 depending onnature of object and kind of monitoring desired. Preferably, target unit4 input sensor 44 processes authenticated voice pattern for properrecognition and/or dialing of user instructions or other languagesyntax, but one or more microphone audio functionality may beuser-selectively de-activated for privacy or activated continuously fordetection and recording.

Communicator unit 46 is coupled to sensor unit 44 to send and/or receivereal-time or store-and-forwarded object data or packets preferablygenerated by sensor 44. Processor 48 and memory 49, including preferablyoperating system and web browser software, are also provided optionallyto enable access and/or processing of data, such as real-time objectdata associated with predetermined website, IP address, or so-calledInternet website hot-link or URL, as received from sensor 44 andaccessible via any corresponding server equipment coupled thereto.

In such self-contained processing configuration, controller 6 mayconduct real-time viewing or analysis of object data. Processor 48 isprogrammable to monitor one or more pre-configured website, i.e.,corresponding to IP address for particular object 2 observable orproximate at certain event or time window, for site hits thereto, oruser modification requests to change object observation or processing asdesired to provide remote object access and modification thereof.

In one embodiment, processor 48 monitors observed input to sensor 44 fornew object data and provides such data to pre-configured webpage site.Controller 6 accesses and views such object data at corresponding siteaddress or URL via Internet browser tool. User instructions and/ormodifications thereto can be conveyed to target unit 4, for example, tochange, select, or adjust particular sensors 44, such as camera focus,zoom, tilt, angle, pan, etc., or other such operational attribute ofsensor device 44 of target unit 4.

Additionally, controller user may provide input to specify or requestcurrent or future monitoring or surveillance of one or more certainlocation (i.e., associated fixed detector site) or object (i.e.,associated mobile target unit site). In this manner, software 66 isconfigured or updated via database records, object movement andobservation rules, object, target unit or controller communicationstherewith, as well as any related transaction, diagnosis, reporting andsecurity considerations appropriate to include, for recognizing orsearching one or more object, or contextual observations at detectorsites or object directories associated therewith.

Variety of remote object surveillance applications are contemplated,such with multiple sensors 44 using video cameras situated at regularintervals or high-traffic locations at remote sites to observe multipleor moving objects.

In case of health care applications, such as remote medical patientmonitoring, sensor 44 may include one or more medical instrumentationfor observing or attachable to patient. Target tracking unit 4preferably includes communicator unit 46 configured such that processorcommunicates medical and/or tracking data and other data about monitoredobject to professional medical or other care-giver disposed atcontroller 6 via communicator 7 and network 8.

In embodiment where object 2 is moveable and target unit 4 is attachedto or moves correspondingly or portably with object 2, target unit 4includes locator unit 46. Locator 46 preferably is implemented usinggeneral navigational functionality such as radio triangulationfunctionality relative to local radio signal sources, or GPS receiverrelative to satellite signaling sources, for determining location oftarget unit 4, and thus correspondingly of moveable object 2 physicallyassociated therewith. GPS receiver functions according to standardinternational telecommunications protocol in functional cooperation withorbiting satellite signals to calculate positional vectors, whichstandards are hereby incorporated by reference.

In this embodiment of target 4, locator 42 couples to communicator 46,which preferably include digital wireless transceiver, such asconventional or proprietary cellular phone-type radio connectivity toassociated radio base station representing communicator 7 coupled tonetwork 8. Hence, object 2 observation and position data from targetunit 4 is accessible by controller 6 via network 8 and communicator 7.

In particular, communicator 7 wireless radio communication functionalitymay be provided through conventional base station, network hub orfunctionally equivalent network or communications equipment of cellularphone, trunked radio, wireless local loop, and/or Internet data serviceprovider. Air interface between communicators 7, 46 may comply withstandard radio protocol (e.g., TDMA, CDMA, GSM, CDPD, IMT-2000, etc.),which standard documents published on-line or hard-copy are herebyincorporated by reference.

For example, cellular phone or pager functionality in communicator 46 intarget unit 4 may transmit navigational or position signal provided bylocator functionality 42 to communicator 7 during conventional cellularor pager roaming or signaling protocol with local radio base station orcell site to report current call or phone status or location. In thisregard, wireless communication service and Internet service providercould be substantially same entity. Controller 6 thus receives objectand object position data via network 8 and/or via servers 5.

Optionally, accelerometer functionality is included in locator 42 toindicate object acceleration in various direction (e.g., x, y, zdirectional axes), particularly actual time and relative direction ofsuch object movement during start or stop events. Preferably,accelerometer signal or data indication of active or relative movementserves to trigger more accurate object position calculation, e.g.,supplemental to and compared with other navigational measurement such asGPS position calculation for object at certain time to verify correct ormore accurate object location. Preferably, accelerometer measurementsare initially calibrated more accurately to coordinate with such othernavigational schema.

Preferably target unit 4 is physically compact and/or rugged portabledevice, appropriate for hand-held use or mounting on instrumentation orin vehicle or automobile dashboard, and includes text multi-media,and/or graphic display output and associated drivers 43. Internetbrowser software may be provided therein to allow user remotecommunication and data access to other applications and databases viathe Internet. Input functionality is provided for sensor 44, includingpossibly keypad, touch-screen, electrical signal port, etc. depending onapplication of target unit 4, such as hand-held use, or coupling tomedical instrumentation.

As described above, target unit 4 may include processor 48 and storage49, as well as communication device 46 having one or more operationalmodes, such as cellular phone, email, browser, fax, and/or 2-way pager.Storage 49 may be implemented using digital video disk (DVD), so-calledsmart card format storage, or other conventional or proprietary storageor memory device.

FIG. 3 shows block diagram of controller 6. Preferably, controller 6 isimplemented in personal or portable computer or other conventionalprocessing platform including output device and drivers 60 (e.g.,display monitor, speaker, 3-dimensional virtual reality (VR) and/orholographic display, etc.), input device and drivers 169 (e.g.,touchscreen, keyboard, buttons, mouse, microphone, camera, etc.),microprocessor 48, and storage 49. Storage 49 may be implemented usingdigital video disk (DVD), so-called smart card format, or otherconventional storage or digital memory device.

Additionally software 66 therein includes operating system such aspreferably Microsoft Windows or other conventional operating system,Internet browser software for accessing and communicating withworld-wide web URL sites, as well as innovative instruction code and anyrelated firmware or circuitry/equipment for analyzing and/or processingdata according to preferred embodiment one or more of followingfunctional modules, as described further herein: network and datacommunications 161, object and map database structure 161, objectmovement processing 163, security management 164, electronic transactionprocessing 165, diagnosis and/or corrective tool 166, performance reportupdater 167, and visual object analyzer 168.

Such modules are generally user customizable and adaptable according toparticular need for object surveillance. Further, such modules may becombined into common seamless programs or partitioned into multipledistinct cooperating program components. Moreover, such modules resideactually, in whole or in part, in controller 6, associated storageperipheral device, or other processing machine or other such controllercoupled thereto or accessible through network 6. Additionally, toimprove program performance, one or more of such modules may be omittedor uninstalled from controller. Furthermore, modules in software 66 maybe provided in layered or hierarchical arrangement. In this manner,low-level core functionality is provided by database structure 162,object movement module 163, visual analysis module 168 and objectdiagnosis tool 166, and next-level functionality is provided by securitymodule 164, communication module 161, transaction module 165, and reportmodule 167.

Preferably, browser software functions according to commerciallyavailable browser product such as, e.g., Netscape Navigator or MicrosoftExplorer, or any other functionally equivalent means for accessingInternet, intranet or other conventional or proprietary LAN/WAN website,network node or IP address.

Controller 6 or other user selection and viewing of desired objects 2 tobe monitored are facilitated by invoking or clicking on one or morewebsites, address or corresponding graphical hot-link icons provided orupdated by target unit 4. Controller 6 access to one or more objects 2may be provided indirectly through intermediate or topical website orparticular page associated with one or more objects 2, associatedlocation, object grouping, or other related object attribute forlocating, searching, or otherwise monitoring certain select object(s) 2.

Optionally, database structure 162 in software 66 of at least onecontroller 6 provided in integrated system includes network searchable(e.g., having IP-addressable sites, links, address subsets thereof, orother deterministic network access scheme) listing or set of controllersand associated users, target units and associated objects, detectors andassociated servers. Preferably database structure is providedasynchronous storage device array format to reduce access delay thereto,including any object or set thereof description, associated movement,schedule, timing, observable images, non-image conditions, states, fees,etc. In this way, preferably Internet search ability of particularobject or object set as well as monitored information such asmulti-media images thereof are achieved, assuming proper authorizationsapply as described herein.

Database structure 162 may include schedule or other temporal schemeassociated with one or more object presence, movement and/or otherobserved condition in one or more monitored locations. In this way,control software 66 or user thereof may compare determined objectpresence or other surveillance measurement thereof against suchscheduled object activity. This allows determination of compliance, aswell as recording or alerting appropriately, for example, when objectdelivery is late, early, on schedule, unscheduled, or absent.Furthermore, by determining actual monitored object schedule, controlsoftware 66 may provide for more efficient local resource allocation andcoordination with such monitored object or set thereof.

Additionally, software 66 may employ one or more intelligent softwareagents to function in conjunction with database 162, communicationsmodule 161, transaction module 165, or movement module 163, as well asother modules included therein. In this manner, for example, uponconnecting controller 6 and/or mobile unit 4 to Internet 8, one or moresuch agents may act on behalf of such controller 6, mobile unit 4, orassociated object 2.

In particular, such software agent(s) effectively extend functionalreach of various module functionality in software 66, such as by:negotiating with other software agents over network server connectionswith one or more fixed detector or server sites and/or mobile targetunits to schedule monitoring, collaborative chat or meeting times; orcoordinating timely delivery of product, services, or other electronicdata or signaling.

Additionally, such agents may serve to retrieve (i.e., “pull” or seekspecific information such as certain objects or medical patients ortheir locations, movement patterns, schedule, or other monitorableattributes), watch or “push” for specific information (e.g., appropriatemedical treatment or medication, target banner advertisements or othercommercial message or reports aligned with known or expected interestsof particular mobile objects), provide integrated system utility helpand diagnostics, or shop or prescribe for fixed products or servicesaccording to object user preference.

In this way, proper timely delivery of hazardous or perishable mobileobjects, for instance, may be ensured, preferably using controllersystem, target unit 4, or GPS receiver generated clock for providingaccurate synchronizing timing signal, and thereby minimizing possiblenetwork signaling latency.

Visual and/or object movement data from sensor 44 includes symbolic orgraphical representation of one or more monitored object 2. Suchrepresentation may include predefined or customizable avatar symbol orreduced thumbnail format, as well as relative location of each detectorpresented in topological map overlay, including positional or temporaltextual or symbolic tags or identifiers associated with particularobjects or detectors proximate thereto. For example, current mobile unit4 and/or associated object 2 location relative to designated home orbase location may be illustrated against map.

Associated graphical and any corresponding textual map data may includedigitized cartographic, street, building, room, layout, elevation,depth, or other multi-dimensional map data. For example, monitoredperson object may be illustrated as having entered building atparticular time. Preferably, current or updated map data, including anyassociated directions, commute traffic or parking data, are downloadablefrom controller 6 or other central map data source to one or more mobiletarget unit 4 for use therein.

Preferably, input 169 is implemented using selection entry interfacefunctions, such as on-screen buttons for indicating user preferences ortext entry in response to various queries from operational controlsoftware 66. Control or performance report 167 functions to generatepersonalized or standard on-screen, hard-copy print-out, file storage ortransfer, or other manner for delivering analytical, diagnostic,statistical, historical, predictive, probabilistic, or other formattedtext or graphical report relating to object monitoring operations ofoverall integrated system managed by controller 6.

Similarly to mobile target unit 4, controller 6 includes detector orother physical or vital medical sensor interface 169,location-determining device 160, such as GPS receiver, local radiosignal triangulation functionality, or accelerometer device forgenerating actual or relative positional signal, and communicationsdevice 69, such as conventional cellular phone or pager functionality.

Additionally, such communications functions 69, 46 may include portablelocal number, universal identity module, or other identifiable value(s)for communicating with particular authorized or associated user. Suchlocal portable number(s), including any prepayment credit value, may bestored on smart card or functionally equivalent portable device which isreadable electronically by controller 6 or target unit 4.

Preferably, communications module 161 functions adaptively to initiate,establish, modify, and coordinate user communication or messaginginvolving text, voice, video, image, or other electronic synchronous orasynchronous signaling between controller 6 and mobile target unit 4, aswell as any other processor or peripheral coupled to network 8. Hence,polling of available objects, detectors, controllers or other networkedresource in integrated system, as well as providing recognized orunrecognized voice or video over data channel, signaling or networkoperation are schema contemplated within the scope of preferredimplementation.

Additionally, communications module 161 may serve adaptively to enablescaleable collaborative or group chat communication between authorizedmultiple entities 4,6 coupled thereto. This configuration may arise inmulti-cast mode wherein multiple observers monitor common objectmovement activity. Also, upon detection of emergency or other urgentmessages (e.g., 911 phone calls from target unit cell phones), relevantobject location, movement, or other conditions are communicated orforwarded immediately. Such messaging may be treated as high-priority toappropriate authorities located proximately to monitored object indistress.

Object and map database structure 162 functions to determine and storeeach monitored object representation, as well as prior, current andlikely future locations, for example, as provided from initializationvalues, fixed detector site measurement or other observation signals,mobile sensor measurement or other observation signals, console ormobile unit user entry, as well as processor calculated, estimated orprojected values. Such database information is useful for subsequentread, write, modify, delete, restrict, or other data access operation.

Data structure may be implemented in one or more constituent datastructures, such as various object-oriented and/or relational datatables. Preferably, stored object data is maintained in dynamically orsimultaneously accessible and updatable database format such thatmultiple object and object related information (e.g., movement,condition, billing, etc.) may be read and processed by more than oneobject processing instance or process.

For example, monitored object data format may be provided including anyof the following values: object name, unique object instance oridentifier, object group or association, object interests or requests,object physical or medical condition, object financial status, initiallocation and time, subsequent locations and times, system flags or othererror indications associated with object, object mobile unit identifier,object digital image, video and/or audio information which may bepre-recorded or delivered from current “live” broadcast or transmission.

Additionally, database 162 maintains associated map databases such thatobject locations may be overlaid thereon as appropriate to show positionand movement. For example, office or residential facility floorspace,rooms or locations are mapped to illustrate relative object movementtherein. In particular, movement processing module 163 functionsprogrammably to track object positions and recognize positionalvariances indicating relative movement, including horizontal, lateral,as well as vertical movements. Preferably, set of monitoring rules orparameters apply to restrict or expand object surveillance scope, suchas specifying various allowed schedules, locations, any monitoring ormetered fee charges, monitorable objects, as well as limiting particulardata types, such as video or audio only, or restricting access tocertain sensitive medical, financial, or other private observable objectcondition or state.

Movement processing module 163 determines when certain object(s) 2 beingmonitored by particular detector(s) has moved or otherwise likely toroam according to determined actual movement vector of such object intonew detection area, unmonitored area, or overlapping area associatedwith different detector. In this manner, control software 66 mayrecognize object movement using module 163, and thereby process 208object movement information to provide proper determination 210 and anyappropriate post-processing thereof. For example, roaming object orobject set may be handed-off to neighboring or next closest or availabledetector-server site, or potentially colliding object vectors may be sodetected and thereby avoided in time.

In accordance with an important aspect of present invention, fixedimaging array of detector sites operationally integrate with locatablemobile units. Fixed and mobile components communicate preferably throughInternet protocol and equipment. Such integrated system enable flexiblyscaleable approach to monitoring object movement therein.

To achieve effective integration, movement module 163 and database 162preferably cooperate functionally to designate one or more object fortracking. Initially, each tracked object is statically represented indatabase with unique object identifier, start location, monitoring timeat such location, as well as other measurable object conditions, such asdirection vector, height, etc. For each tracked object, module 163determines whether such object has associated target mobile unit 4and/or detector server site within range to observe such object. Mobileunit 4 may be registered in database 162 to indicate association withparticular object. Object initial location (e.g., Cartesian coordinates)may be compared against current list in database 162 of functionaldetector server sites determined to be electronically accessible toInternet and physically located within range to observe object.

Continuous or dynamic streaming information about particular object(s)may be obtained as well, for example, in live video or audio feeds.Object designation may be invoked by user request to locate particularobject or set of objects. Initial values may be user-specified, derivedfrom pre-defined object movement schedule, or actually determined fromintegrated system field measurements (i.e., mobile unit or detectorsites). Accurate timings may be generated from or synchronized withglobal clock signal available from GPS receivers.

Then, after certain time interval elapsed from initial object monitoringevent, next object monitoring event occurs. Subsequent objectsurveillance sessions may occur according to random, regular,intermittent, or otherwise scheduled or triggered times (e.g., by mobileaccelerometer or fixed motion detector activates in response to objectmovement). Also, sessions may be repeated to provide iterativecalculations of more refined and accurate measurements of objectmovement, for example, using smaller time intervals.

So, during next event to monitor tracked objects, new measurements areobtained from any associated target mobile unit 4 and/or detector serversites within observation range. Preferably, substantially during suchmonitoring event or period, mobile unit 4 provides GPS locationinformation associated with tracked object, while observing detectorsdeliver one or more image of tracked object. Such integrated approachprovides corroborated surveillance, i.e., that target object isevidently observed to be located at certain location at particular time.

Hence, during normal integrated system operation, mobile tracked objectactivity traveling from one observation area to another area may serveto trigger and cause movement module 163 to activate such neighboringfixed detector server sites. In another case, console user merelyrequests to know which objects are presently in an observable area(i.e., query: who are all here?). In such case, fixed observation datamay serve user to trigger and cause one or more mobile units disposed insuch area to submit their information (e.g., associated objectidentifier, location, time, etc.) As appropriate, database 162 isupdated when certain observation detector or sensor sites are triggeredto monitor.

To increase degree of remote surveillance further, other detector alsowithin observing range, but having different viewing angle, zoom,lighting, etc., may be caused to monitor target object. Other sensors inassociated mobile unit may also be caused to monitor target object inadditional ways, e.g., by activating medical instrumentation to takepatient vital measurements. Orchestration of fixed and mobileobservation measurements upon tracked object may be specified oncase-by-case basis depending on surveillance application.

For example, system flag may be issued or displayed when tracked objectis determined to be absent from scheduled location monitored by certaindetector at scheduled time. Additionally, error may be indicated whensame object identifier is determined to be detected at multipledifferent observation sites, but at substantially same time (since thiscondition may suggest fraudulent or pirated object or associated mobileunit). Furthermore, urgent notice may be delivered to console whenemergency is signaled from object through fixed or mobile observationchannels.

Preferably, movement module 163 continues operating to determine andupdate tracked object location and times, even when one or moreobservation values from various fixed or mobile detector, sensor, orlocator functionalities are temporarily disengaged or inaccessible.During such down periods, movement module 163 may use last storedinformation about particular tracked objects available in database 162,or provide extrapolated or predicted object location at future timesbased on schedule or most recent movement extrapolation (e.g., accordingto object direction, speed, etc.).

Security and access processing module 164 functions programmably oradaptively to limit, encrypt (e.g., using public or private keyencryption scheme), or secure user access to system, particularlydatabase 162. In this way, individuals seeking to monitor certainobjects, for example, may be pre-authorized and/or authenticated usingone or more digital certificate. Such digital certificate may includeperson name, address, bank brand, timestamp, public key, and is cashedand signed by issuer digital signature. This screening method may applyto health-insured or multi-cast designated member observers or excludingun-insured or under-aged children or other vulnerable or unqualifiedgroup or objects from pre-specified monitoring or commerce transactionactivity.

Security access criteria for program rating and screening may complywith federally or privately published standards for so-called V-chiptechnology, which are hereby incorporated by reference. In special oremergency circumstances, security to object database and recorded and/oractual object surveillance and movement data may be over-ridden (i.e.,trap door) to provide access to general or specific object information.

Security and access module 164 may determine or recognize authorized,preferably according to location-based and/or associated object movementconstraints, controller user or mobile object seeking to communicatewith integrated system through authenticated sensor or input viaacceptable voice pattern, finger-print pattern, handwritten signature,magnetic or smart card signal, etc. For example, module 164 records andissues alert when intruder target unit 4 is determined or appears to bemonitoring object 2, based on geographically correlated object/targetunit 4 movement provided to console 6, i.e., although unauthorized to doso.

Additionally, access to certain detectors or corresponding sites wherecurrent or historical access activity is relatively high, or results innoticeable network congestion, may be limited. Purpose here is toprovide dynamic load balancing, whereby network usage is collected,measured, analyzed, and re-allocated to different available networkingand detection resources.

Fraud detection feature may be included to identify, record and alertagainst unauthorized user, input pattern, or other predictable orunrecognizable signature or electronic behavior. Integrated systemattempted and/or successful access thereto via network ports, servers,or other access connections are logged and traceable, preferably bygeneral or specific geographic location. Furthermore, object monitoringservices are preferably restricted according to specified rules, asdescribed herein, including authorized observers, times, locations,objects, etc. Preferably, module 164 employs conventional networkfirewall protection.

Transaction processing module 165 functions preferably during objectprocessing and/or diagnosis to manage user, advertiser, vendor servicebilling, or other commercial transactions using integrated system. Forexample, transaction processing module 165 may initiate, activate,update, combine, separate, terminate or otherwise process user accountsassociated with one or more user controller 6 or monitored objects 2, ormeasure and/or restrict actual object 2 or controller 6 usage ormonitoring time, range, location or scope. This is achieved preferablyselectively according to specified billing or pricing schedule, or otherrate scheme to provide regulated user charges on credit or corporateaccounts as well as location-based and temporal-based charges.Transaction processing module 165 interacts through textual, graphical,sound, and/or video interface with user through appropriate input and/oroutput functionality of controller 6, and/or object 2 through targetunit 4.

Moreover, transaction processing module 165 may record and analyzeactual past or current, or potential future market demand, wants orneeds according to user (user controller and/or object set)demographics, geographic location, movement pattern, preferences,consumption, transaction, or other commercial activity, behavior orinformation, particularly arising from object monitoring usingintegrated system. Hence, important objective is to providecustomer-centric electronic transaction scheme.

Optionally, transaction processing module 165 in cooperation with one ormore other modules in control software suite 66, provides real-time,dynamic, targeted and/or selective notification, delivery, advertising,educational, pricing, inventory quantity, and/or other business sales,distribution or marketing interactive or static text, graphics, voice,and/or video data information and/or associated electronic signalingpertaining to one or more commercially available or soon-to-be-availableproduct and/or service.

It is contemplated further that such solicited or unsolicited product(e.g., text document, such as books, news, sports, or stock report;graphics, such as greeting card, or other artwork; data, such asresearch databases, person or item listing, or other electronic filetransfers; sound, such as live or recorded voice or instrumental musicor newsbroadcast); or service (e.g., professional services, electronictool access, commercial transactions, etc.) may be deliveredelectronically. Such delivery could be through on-line Internetdistribution, publishing or access otherwise via Network 8 to usercontroller 6 or object 2, as monitored according to present invention.

Furthermore, in such operational mode, transaction processing module 165may depend on known (e.g., based on reported or requested consumer wantor need data) and/or expected (e.g., based on demographic, social, orother relational group behavior and/or predicted, extrapolated oradaptively calculated consumption pattern thereof) interest of one ormore object 2 or user controller 6, within certain observable ormonitorable group or surveillance location or region. This appliesparticularly in shopping, initiating, bidding, negotiating, accepting,modifying, or completing one or more commercial or private transaction,initiates or offers (i.e., unsolicitedly “pushes”) commercialinformation to one or more potential buyer controller 6 or object 2; orresponds or replies (i.e., solicitedly “pulls”) by delivering commercialinformation to one or more potential buyer controller 6 or object 2, orby responding appropriately thereto (e.g., auction bid, acceptance ofoffer, counter-offer, request for more product or service information,etc.).

Hence, in accordance with one aspect of the present invention, improvedelectronic commercial transaction methodology is provided generally suchthat one or more potential buyers and one or more potential sellers(i.e., wherein any buyer or seller may correspond to user controller ortarget unit object having certain observable or monitorable attributes,as described herein) communicate digitally through Internet or othersubstantially equivalent networking facilities.

In particular, such integrated system for enabling remote objectsurveillance-based commercial transaction is preferably achieved byconsidering potential buyer or object movement relative to fixed ormobile resources (i.e., products or services), thereby optimizinglocalized consumer satisfaction. For example, using integrated system,mobile “yellow pages” or other local vendor or available productlisting, possibly provided in local mobile or fixed “kiosk” transactionstation for obtaining certain commercial data, or actually completingtransaction, improves likelihood of matching mobile consumer wants orneeds with nearby product or service resources. In this manner, module165 may only bill customer for actual usage time or benefit derived.

Diagnosis and/or corrective-action tool 166 functions generally toobtain and analyze integrated system status as well as object monitoreddata, particularly prior, current, and predicted object position,movement, image, as well as other physically sensed information. At anytime, tool 166 may conduct network configuration and connection test to“ping” or otherwise sense state, condition, status, location, of one ormore controller, detector, server, target unit, or object otherwiseconnected thereto.

Tool 166 may adaptively provide positional or directional functionalitygenerally to alert authorities or other interested parties whenundesirable object or movement is monitored. Examples may include: whenassociated child, wheelchair, hiker, golfer, luggage or other vulnerableor valuable person/item object is recognized to be located, havingmoved, or imminently expected to move outside familiar or safelocations; or when associated delivery, transport, or emergency or otherservice vehicle object is recognized to be located, having moved, orimminently expected to move outside proper or more efficient streettrajectory, path or other preferred route.

Optionally, diagnosis tool 166 may programmably simulate expected objectbehavior. Simulation may logically, functionally or behaviorally modelmovement, or other monitored activity, based on interpolated valuesbetween actual detected values, or extrapolating further movement intime, for example, according to actual historical detected values ofobject movement. In this manner, diagnosis tool 166 may include one ormore simulation models of certain object or object sets 2 usingmonitored object data from fixed and/or mobile detection sources.Depending on simulated or predictive object behavior, controller mayrecommend or take corrective action.

Additionally, in medical diagnosis context, it is contemplated thatintegrated system may be employed locally or remotely by qualifiedmedical professionals to monitor and diagnose patient vital conditionsfrom monitored signals using sensor detector 44 in mobile unit 4 coupledto controller 6 through network 8. For example, emergency medical datasuch as severity, timing, etc. may be relayed directly from mobiletarget unit 4 at crash site or ambulance to hospital emergencyfacilities.

Moreover, in commercial transaction or direct marketing context, it iscontemplated that integrated system may be employed locally and/orremotely to conduct object movement-based or other monitoredattribute-based targeted product or service advertisement, offer,counter-offer, acceptance, or other communication between buyer andseller. Advertisement may be invoked electronically for on-line viewingin banner display format, preferably targeted according to known orexpected object or user demographics, behavior, or request.

Hence, when object 2 is associated with customer of certain product orservice provided by controller 6 user associated with vendor thereof,integrated system is appropriate for providing improved services. Suchservices may include customer interaction, communication, tracking andsupport, for example with respect to automobiles, to notify regularlyscheduled times for car repair service or part replacement such asbattery of object car product, or detect unscheduled object activity ormonitored conditions, such as electronic signal indication of flattires, discharged emergency air bag, vehicle accident, empty fuel gauge,exceeding certain speed limit, stolen vehicle operation (e.g., hot-wiredignition), etc.

Performance report module 167 serves programmably to define, format, andgenerate requested, personalized, pre-defined or other useful textualand/or graphical information corresponding with operational attributesand statistics of integrated system operation. For example, as scheduledor requested, reports are provided regarding excessive object presenceor movement within particular area, object movement update with respectto one or more monitored patient condition, residential or commercialfacilities and grounds, vehicle or transit paths condition, goodsproduction or inventory, etc. Hence, to improve inventory management,module 167 may provide report detailing status and capacity for dropshipments, just-in-time inventory, from-stock inventory, etc.

Data reporting may provide real-time delivery of current object locationand movement relative graphically to 2 or 3 dimensional map overlaidthereon. Object imaging and locations from detector servers and/orsensor measurements and locations may be displayed on console screen aswell. Emergency, error, or other system flags may be indicated.

Visual analyzer module 168 is optional and functions programmably toprocess, preferably in multi-dimensions, digital image or videoinformation to attempt to recognize, store, compare, or otherwiseprocess visually observed information regarding monitored objects.Module 168 preferably serves to detect object movement or activitywithin monitoring scope of certain detector sites. This may be achievedat certain times by comparing or correlating observable similarities ordifferences between initial and subsequent surveillance data therefrom.For example, module 168 may serve object image queries and attempt torecognize, retrieve from image database, or otherwise capture image ofperson or object associated with target unit 4 determined recently tohave entered detector observation scope, or interacted with mobiletarget unit 4 sensor 44 or fixed detector 4 by communicating therewiththrough voice message, e-mail, facsimile transmission, smart-card or keyentry, finger-print tactile sensing, etc.

In FIG. 4, flow-chart shows operational steps, including initial setup200 of integrated system configuration (e.g., coupling controller(s),detector(s) and server(s) to Internet, providing identifiable networkaddress for each coupled detector, target unit, controller, etc.).Additionally, initial setup may include database initialization, systemping test, detector polling and calibration, security access definitionsor authorizations, permitted object monitoring rules, billing schedules,taxation rates, and object or map database definition, as specifiedadaptively herein for different object class, locations and/or times.

Preferably, network 8 connection by controller 6 to server 5 anddetector 3, or to target unit 4 through communicator 7 is substantiallycontinuous or dedicated, although may be established from time to time,for example, through conventional telephone dial-up modem, IntegratedServices Digital Network (ISDN), digital subscriber Line (DSL), cablemodem, 10Base-T, or other remote access procedure to or from InternetService Provider (ISP) switch or router.

Optionally, to provide improved system reliability and fault tolerance,it is contemplated that integrated system may employ redundant,mirrored, or shadowed configuration employing identically maintainedsecondary controller, including equivalent object, detector, historical,current, predictive database, conditions and state. In this manner, whenprimary controller 6 somehow fails, or encounters substantialperformance problems, secondary controller may be activated to providefail-safe or uninterrupted object monitoring service.

Additionally, controller 6 may serve to reduce system congestion arisingfrom many qualified users attempting to monitor the same object(s). Thisresult may be achieved particularly by limiting total number ofmonitoring users from simultaneously accessing common website locationrepresenting certain object detector locations, or by providingdistributed or shared access to common website location among multiplemonitoring users, such as in multi-cast mode.

Preferred integrated system operation and methodology achieves improvedremote object surveillance and movement tracking generally in anoverlaid fixed and mobile networked infrastructure. Fixed networkincludes console units 6 connected via Internet 8 to multiple electronicdetector units 3, disposed at strategic observation sites fixed aboutscheduled or possible paths wherein mobile objects 2 may traverse fromtime to time. In this fixed arrangement, object surveillance is achievedas console accesses servers 5 coupled to one or more correspondingdetectors 3 to monitor objects 2 within observable range.

In particular, software 66 specified herein includes visual module 168and movement module 163 which may provide certain object recognition andmovement tracking thereof, such that when particular object moves, forexample, from one observation area to neighboring area, consolemonitoring switches from one detector to another detector havingimproved observation position. Additionally, in case of object movementover relatively longer distances, module 163 serves to track objectprogress, as well as various object condition changes, such as fuellevel, health condition, cash reserves, etc.

In significant part of preferred methodology, object movement monitoringis achieved by conducting initial surveillance of object set. Then,object is allowed time or opportunity to move, and follow-onsurveillance of such object set is conducted. Database including objectstatus and detected movement thereof provides accessible archive todetermine object movement for subsequent processing. Fixed system,however, may provide limited object surveillance and particularlymovement capability, depending on effectiveness of moving objectrecognition. Preferably, module 168 determines empirically likelihoodindication of correct/incorrect object recognition, for example,depending on historical matching database of prior similar objectsand/or conditions.

Accordingly, in part to provide improved object movement determination,mobile system is overlaid upon such fixed system. In this way, eachtracked object 2 is physically accompanied by target unit 4, whichincludes accurate location-determination facility, sensor apparatus forobserving object 2, and wireless communication transceiver for linkingto network 8 and controller 6 through fixed communicator 7 coupledthereto. In this mobile subsystem overlay, remote object surveillanceand movement are significantly enhanced by allowing console 6 todetermine more definitively from target unit 4 identity, location, andother physically measurable condition of associated object 2.

More particularly, in accordance with an important aspect of the presentinvention, console 6 may coordinate remote observation activity attargeted sites. Coordination is done by selecting more accuratelyproximate detector-server nodes to track mobile objects 2 according tocorresponding object location delivered by associated target unit 4 toconsole 6. Hence, in integrated fashion, console user leverages existingglobal Internet connectivity as well as geographically distributeddetector and server set coupled thereto. Also, wireless mobileflexibility is provided by properly equipped target units attached orincluded physically with certain monitored objects.

Firstly, based on various initializing factors for determining objectlocation or surveillance, such as initial polling results from one ormore target units 4 or detectors 3, retrieved object site information,object movement search results, or initial, preferably authorized,detected observations or other monitoring surveillance 202 performed onsubject object(s), initial positioning or surveillance for one or moreobject may be determined. Such initial information may be displayedgraphically preferably relative to corresponding map data, based onelectronically observed measurements, data, signals, or pre-definedobject context or related values, relative to map database or othercomparable contextual database.

Monitored object set may also be defined according to user-requestedsearch terms for finding and/or prioritizing relevance of specific orqualified object members of particular class or other searchableattribute, e.g., find all doctors in “94062” zip code area, or find“Elsa” the dog (who may be wearing a trackable target unit on dogcollar). According to preferred methodology, object monitoring may beinvoked by causing controller browser to initiate session call foraccessing website address associated with server-detector associatedwith particular object.

Preferably, database 162 maintains one or more object representation,instance, state, condition, movement, and/or other associated monitoredinformation, such that at any particular moment, multiple objects 2 maybe monitored and processed effectively in parallel according tooperational steps of FIG. 4.

Monitored object set may be assigned expected time, location, or otherphysical conditions, such as medical state, each assigned value orsubstantially similar value within allowable range, say +/−15%variation. In this case, initial values or conditions may be set inintegrated system, such that proper values are monitored accordingly,for instance, activating video detector(s) located most closely toparticular monitored object.

Next, object movement or transition may occur 204 after or during aspecified time period, which may be regular, random, triggered, orpre-scheduled. During such temporal period, object physical state, suchas location, vehicle, luggage, patient, nanny, bank teller, vehicletraffic, or prisoner condition may change. As appropriate, GPS receiverin mobile unit 4 may provide universal clock signal source forrelatively accurate synchronization within integrated system.

Then, based on secondary authorized and detected observations ormonitoring surveillance 206 performed on subject object, or secondarypolling results therefrom, secondary position or condition isdetermined. Preferably, integrated network configuration determinationor ping test upon one or more associated controller, server, detector,or object coupled thereto is conducted to recognize current networkparticipants and corresponding configuration, conditions or states.Hence, when such testing reveals defective or unresponsive detector orserver site, then such site is deactivated and removed from activedatabase, until problem is resolved.

In accordance with an important aspect of present invention, integratedapproach combining positional data (e.g., processed GPS or othertriangulated radio signals) and visual data (e.g., observed real-timevideo or other digital image), or other physical sensory data (e.g.,patient medical vitals) are obtained. Such data are obtainable by set offixed or relatively fixed (e.g., video cameras) or mobile (e.g., GPSreceivers) disposed at various locations about monitored object presenceand activities. Such integrated network of sensory and positionaldetectors may be arranged along streets, highways, bridges,intersections, elevators, buildings, restrooms, classrooms, hotel,offices, hospitals, prisons, storage warehouses, churches, stores, andvirtually any other practical location of monitorable human or animalactivity.

To address potential individual privacy sensitivity or objection tobeing monitored, certain locations may be omitted from detection, orrequire approval prior to or while being monitored. Additionally,monitored object(s) may be provided current list of monitoring usersource names, class or total number.

Next, object analysis and movement processing is performed and/orgraphically displayed 208. Here, relative movement, acceleration orother object physical condition shift or other detected transformationis accomplished when spatial or other physical variance betweentemporally spaced measurements is detected and accordingly shownon-screen preferably animating object movement against relative mapdata. Preferably, object recognition and condition monitoring, includingany monitored changes thereto, are achieved. Such object processing isachieved via visual, video, or image processing, as described herein foroptional module 168, to recognize or correlate particular observableobject attributes, and/or by GPS or other radio triangulation positionalsignal information and any corresponding sensed object identifier orsignature information, as determined over different or scheduledmonitoring times. Preferably, any substantial difference of measuredlocation values are reconciled in favor of GPS location calculation overother position or navigation scheme, particularly when selectiveavailability (SA) thereto is set substantially to zero.

Object movement relative to appropriate map overlay may be illustrated,for example, in two or three dimensions statically or dynamically. Inthis way, each object instance may be symbolically represented byreduced-size or thumbnail graphical or textual icon or avatar on outputdisplay.

Then, object movement diagnosis, corrective-action, or transactionprocessing is performed 210. In this regard, data processing may becase- or application-specific as described herein to the extent thatuser or object condition changes warrant case-specific diagnosis,correction, remote repair, or transaction services.

In accordance, with one aspect of present invention, improvedmethodology and system are provided to determine remote and/or localmobile object movement. Such movement is based on monitored or detecteddata from one or more fixed detectors coupled to Internet or othernetworking interconnection. Further, such movement determination isemployed in subsequent process activity, such as targeted commercialtransaction, remote health care, public or private facility, goods,mobile, or staff surveillance.

For example, upon indication by mobile target unit 4 of low-power sourcecondition, integrated system facilitates via module 210 sleep modeoperation and/or provisions for localized power supply by controller 6notifying particular target unit 4 with low power source via network 8and communicator 7 wireless connection of convenient or nearby re-chargeoutlet or battery inventory.

Finally, as shown, performance report may be generated and/or deliveredpreferably according to schedule or request as well as targeted deliverysite according to requester or object locale. Ongoing console display ofmonitored objects, movement, maps, flags, etc. may be provided. Then,database is updated accordingly 212, for example, when excessive orunscheduled object presence or movement is detected. As appropriate,steps are repeated 213, or adapted according to any revisedinitialization values, to accommodate further object movement.Optionally, software 66 may employ neural-based or adaptive learning forhigh-transaction processing for tracking real-time data associated withmultiple object surveillances and/or movements.

Therefore, to summarize key features of inventive methodology andsystem, following general steps are provided in brief sequential formatas implemented in preferred solution:

-   1. Integrated Overlay. Provide integrated surveillance and    communication system, wherein mobile units are overlaid with fixed    detector network. Both fixed and mobile units are accessible through    the Internet.-   2. Fixed Detection. Console user monitors object movement through    multiple camera detectors coupled through the Internet.-   3. Mobile Detection. Console user monitors object movement through    mobile unit sensors and locators coupled wirelessly through the    Internet.-   4. Object Analysis. Control database and software combines fixed and    mobile object data to monitor object movement relative to fixed    surveillance sites. Fixed detectors observe object presence within    certain area, while mobile sensor provide more accurate location as    well as object sensor data. Database tracks historical, current, and    predicted movement of object sets, thereby facilitating object    search.-   5. Processing Services. Commercial transactions deliver products and    services more effectively to mobile object consumers. Secured access    and graphical map outputs enhance system usefulness.

Although the principles of this invention has been illustrated in thepreferred embodiment in accordance to a surveillance application, it isintended that the principles of this invention to be also applied toother applications, such as patient monitoring, person, vehicle, orproperty tracking and monitoring.

Thus, the foregoing described embodiments of the invention are providedas an illustration and description. It is not intended to limit theinvention to the precise form described. Other variations andembodiments are possible in light of the above teaching, and it is thusintended that the scope of the invention be limited by the detaileddescription, but rather by the claims as follow.

1. A method comprising: monitoring a consumer via a wireless networkcoupled to a detector network, wherein a detector in the detectornetwork detects an attribute associated with the consumer; extrapolatinga predicted future location of the consumer based on last storedinformation associated with the consumer in order to obtain anobservation range of the detector network into which the consumer isexpected to be moving in the future; and transmitting, in response tothe attribute and the extrapolating the predicted future location, anunsolicited advertisement to the consumer, wherein the unsolicitedadvertisement is a future advertisement associated with a vendorassociated with the observation range into which the consumer isexpected to be moving in the future.
 2. The method of claim 1, whereinthe consumer is a health-care patient, and the unsolicited advertisementis transmitted to a cellular phone that comprises a signal port coupledto a medical instrument for monitoring the health-care patient, andwherein the attribute associated with the consumer is health datareceived from the medical instrument.
 3. The method of claim 1, whereinthe monitoring comprises using at least one of a neural-based softwareor an adaptive learning software for visually recognizing the consumerbased on data from at least one of a fixed imaging array or a mobileimaging array of at least one of detectors or sensors.
 4. The method ofclaim 1, wherein the consumer is associated with a vehicle, and theunsolicited advertisement is transmitted to a cellular phone comprisinga GPS receiver for generating a clock signal to synchronize at least oneof a scheduled service or a scheduled repair of the vehicle at thevendor associated with the observation range.
 5. The method of claim 1,wherein the unsolicited advertisement comprises a software simulation ofa drop-shipment of at least one of a product or a service.
 6. The methodof claim 1, further comprising determining an actual movement vector ofthe consumer, wherein the extrapolating the predicted future location ofthe consumer is in response to the determining the actual movementvector.
 7. A system comprising: a detector network comprising a detectorconfigured to detect an attribute associated with a consumer; and acontroller configured to extrapolate a predicted future location of theconsumer based on last stored information associated with the consumerin order to obtain an observation range of the detector network intowhich the consumer is expected to be moving in the future; wherein thecontroller is further configured to transact with the consumer by:selecting an unsolicited future advertisement for at least one of aproduct or a service in response to the extrapolation of the predictedfuture location and the attribute associated with the consumer; andtransmitting the unsolicited future advertisement to a mobile deviceassociated with the consumer.
 8. The system of claim 7, furthercomprising: a plurality of fixed detectors associated with the detectornetwork, wherein at least one of the plurality of fixed detectors isconfigured to observe the observation range; and a plurality of mobiledetectors associated with the detector network, wherein at least one ofthe plurality of mobile detectors is configured to detect the attributeassociated with the consumer.
 9. The system of claim 7, wherein theunsolicited future advertisement is for at least one of a physiciancapable of treating the consumer or a medical product capable oftreating the consumer.
 10. The system of claim 7, wherein theunsolicited future advertisement is associated with the at least one ofthe product or the service, and wherein the unsolicited futureadvertisement comprises at least one of delivery information,advertising information, educational information, pricing information,inventory information, sales information, distribution information,marketing information, text, graphics, voice information, or datainformation.
 11. A mobile device comprising: a sensor configured tosense an attribute associated with a consumer; and a processorconfigured to control the mobile device to: communicate with acontroller to facilitate an extrapolation of a predicted future locationof the consumer based on last stored information associated with theconsumer in order to obtain an observation range into which the consumeris expected to be moving in the future; and receive an unsolicitedfuture advertisement for at least one of a product or a serviceassociated with a vendor associated with the observation range intowhich the consumer is expected to be moving in the future, wherein theunsolicited future advertisement is in response to the extrapolation ofthe predicted future location and the attribute associated with theconsumer.
 12. The mobile device of claim 11, wherein: the attributeassociated with the consumer is an attribute associated with an objectthat is associated with the consumer; and the attribute is at least oneof an object interest, an object characteristic, an object value, anobject financial status, an object initial location, an object initialtime, an object subsequent location, an object subsequent time, anobject digital image, or object audio information.
 13. The mobile deviceof claim 11, wherein the controller is configured to communicate with afixed detector that is configured to observe the observation range, andwherein the fixed detector is configured to be activated in response tothe extrapolation of the predicted future location of the consumer inorder to obtain the observation range.
 14. The mobile device of claim11, further comprising a GPS receiver for providing a location of themobile device to the controller.
 15. The mobile device of claim 12,wherein the object is a vehicle in which the consumer is riding.
 16. Acontroller, for use with a wireless network, to facilitate a commercialtransaction between a seller and a buyer, wherein the controller isconfigured to: extrapolate a predicted future location of the buyerbased on last stored information associated with the buyer that isreceived from a detector communicatively coupled to the controller andconfigured to provide data associated with the buyer; associate alocation of the seller with the predicted future location of the buyer;and communicate a future advertisement from the seller over the wirelessnetwork to the buyer in response to the predicted future location of thebuyer and the data associated with the buyer.
 17. The controller ofclaim 16, wherein: the data associated with the buyer comprises at leastone of demographic information, movement pattern information, preferenceinformation, consumption information, behavior information or geographiclocation information; and the future advertisement is generated inresponse to the data associated with the buyer, wherein the futureadvertisement is associated with at least one of a product or a serviceoffered by the seller.
 18. The controller of claim 16, wherein thecommercial transaction relates to electronic product delivery to thebuyer of at least one of a book, a greeting card, a news report,artwork, or a music transmission.
 19. The controller of claim 16,wherein: the detector is configured to send image data to thecontroller; and the predicted future location of the buyer is estimatedat least in part in response to the image data.
 20. The controller ofclaim 16, wherein: the detector is configured to detect a radiofrequency identification (RFID) device associated with the buyer; andthe predicted future location of the buyer is estimated at least in partin response to the detection of the RFID device.
 21. The controller ofclaim 16, wherein the communication with the buyer is based on acombination of an actual proximity and a projected proximity of thebuyer to the seller.